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Abstract. The objective of this experiment was to 
determine the best possible input EEG feature for clas- 
sification of the workload while designing load balanc- 
ing logic for an automated operator. The input features 
compared in this study consisted of spectral features of 
Electroencephalography, objective scoring and subjec- 
tive scoring. Method utilizes to identify best EEG feature 
as an input in Neural Network Classifiers for workload 
classification, to identify channels which could provide 
classification with the highest accuracy and for identifi- 
cation of EEG feature which could give discrimination 
among workload level without adding any classifiers. The 
result had shown Engagement Index 1s the best feature 
for neural network classification. 

Keywords: Cognitive Workload, Discrete wavelet 
transform, EEG spectral feature, Neural Network. 


1. INTRODUCTION 


Cognitive Workload is defined as the 
load generated due to processing of multiple 
activities (or sub activities of a task) by the 
human brain in the time domain. In our con- 
text, it depends on how efficiently there is an 
interaction between operator’s resource capa- 
bilities and computer/machine on which the 
tasks have to be displayed. When the opera- 
tor’s workload is at the peak, then a properly 
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designed automation task can reduce workload 
or maintain its optimal level (Kramer, 1991). 
Workload assessment of operator during task 
can offload some of his tasks to the machine 
with the help of smart system design. For 
designing of such system, psychological and 
physiological aspects are carefully assessed for 
finding out suitable combination that can pro- 
vide optimum utilization of human resource 
with the machine. In this research paper, we 
tried to identify EEG channels with the best 
feature that could give a maximum classifica- 
tion of workload. It also included feature iden- 
tification without adding any classifiers. There 
are three methods to assess the cognitive 
workload, i.e. task score, subjective score and 
spectral features of the EEG (Wickens, 1988). 
Workload assessment through giving a ques- 
tionnaire about a task makes subjective judg- 
ments about the task (Reid and Nygren, 1988). 
Multi Attribute Task Battery (MATB-II) was 
used for workload assessment in two modes, 
LWL and HWL. It was used for multitasking 
as well as for workload assessment (Singh, A. 
L., Tiwari, T., Singh, I. L, 2010; Singh, I. L., 
Sharma, H., Singh, A. L., 2005). Advantage of 
choosing MATB over others were its qualifi- 
cation for providing objective and subjective 
scoring along with different level of workload 
(Hart and Staveland, 1988). 

Different Attentional demands like 
to divide attention which is generated by a 
task change pattern of subjective workload 
and its psychological impacts (Mazloumi, 
Kumashiro, Izumi, and Higuchi, 2010). There 
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is a nonlinear relation between workload and 
performance (Gawron, 2000). Therefore, we 
didn’t rely completely on subjective & objec- 
tive scores; we included electrophysiologi- 
cal (EEG) factors also (Gevins and Smith, 
2003). There are a lot of research articles that 
show significant relationships between EEG 
parameters like engagement indices and per- 
formance both in fields and off fields (Berka 
et al., 2007; Freeman, Mikulka, Scerbo and 
Scott, 2004; Mikulka, Scerbo and Freeman, 
2002). EEG analysis is performed using clas- 
sically defined frequency bands alpha (8-12 
Hz), beta (13-22 Hz), delta (23-30 Hz), theta 
(5-7Hz) and gamma (30-70 Hz) (Dickson, 
2005; Dorneich, Ververs, Mathan and Whit- 
low, 2005) or sometimes it can be analyzed 
using some ratio of frequency bands, Prinzel 
et al (2000) developed an EEG-engagement 
index based on beta power divided by alpha 
power plus theta power. A feed forward neural 
network based on back propagation algo- 
rithm was used to classify the workload into 
NWL, LWL and HWL among 14 channels in 
MATLAB 2012. 

The objective was (i) Comparison 
among input features to determine their quali- 
fications as a workload level discriminating 
factor. Here input features included objective 
scores, subjective scores and EEG features. (11) 
To determine the most suitable input feature 
that can be used in designing human-machine 
load balancing logic for an automated opera- 
tor. It was based on statistical parametric test- 
ing that gave output with significance. 


2. MATERIALS AND METHODS 
A. Procedure 


Subjects (n=10, age group 20-30 years, 
all male and right handed) from the Institute 
of Nuclear Medicine and Allied Science, 
New Delhi were invited to perform NASA‘s 
MATB-II pilots multitasking tasks, which had 
no prior experience of MATB like piloting 
tasks. Consent was taken from all subjects to 
participate in this project. They were required 
to fill a questionnaire to build their general 
profile. Each subject was well trained with the 
MATB-II software at the beginning of the test- 
ing as per given module of MATB-II software 
(Fairclough and Venables, 2010; Fairclough, 
Venables, and Tattersall, 2005).Lab ergonom- 
ics were followed by the idealarrangement. 
The MATB-II task stimuli was presented on 
a computer screen (15 inches) with a dark 


background and a viewing distance of 80cm. 
EEG from each subject was recorded with 
low-cost EEG device Emotiv EPOC (Knoll, 
Wang, Chen, aand Xu, 2011) which was a 
14-channel, 128 Hz neuro-signal acquisition 
and processing wireless neuro headset (Figure 
1). 

The following steps were performed by 
the subjects for workload assessment through 
the tasks assigned as per NASA‘s MATB-II, 
which was designed according to an eight 
minute event file. 


1. During the experiment, three min- 
ute baselines was recorded with eyes open. In 
this situation, a laptop screen with no lumines- 
cence was kept in front of the subject‘s eyes. 

2. 1 minute rest. 

3. NASA MATB-II tasks at Low work- 
load level were given to subjects. 

4.1 minute rest. 

5. NASA MATB-II tasks at High 
workload level were given to subjects. 


Figure 1. Lab Arrangement 
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B. Technique 
(1) Feature Extraction 


Root mean square (RMS) value 


The RMS value is mainly used for vary- 
ing a quantity and useful statistical parameter 
to see the effect of workload on EEG signals 
(Basmajian and Luca, 1985). It is useful to 
measure power in amplitude of EEG signals 
from the cerebral cortex (Abdul-latif, Cosic, 
Kumar, Polus, and Da Costa, 2004). 

The RMS for a collection of N values 
{xl, x2, ..., XN} 1s given by the equation 





a = 2 


Xp g — 
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Sub band Energy 


Wavelet packet node energy is more 
useful in representing a signal. Wavelet packet 
component energy E and total signal energy 
can be defined as 


Multi-channel full-band EEG signals are 
decomposed into five well-known frequency 
sub-bands: delta, theta, alpha, beta, and 
gamma. Different energy bands like gamma, 
alpha, beta and theta have been calculated 
with MATLAB programming (Sun, 2008). 


Power Spectral Density (PSD) 


The power spectral density is mostly 
directed at the continuous spectrum of the 
signal (Sun, Chang, and Tang, 2006). In con- 
trast to the mean-squared spectrum, the peaks 
in this spectrum have no reflection of the 
power at a given particular frequency (Zarjam, 
Epps, and Chen, 2011). 


Engagement Index (EI) 


Task engagement is defined as how 
much the subject is involved in particular tasks 
on different levels of workload (Kamzanova, 
Matthews, Kustubayeva, and Jakupov, 2011). 
EEG engagement index denoted by formula 
(B/(a+08)) and has been to classify workload 
(Berka et al., 2007). 


(41) EEG Signal Analysis 


EEG signal processing means for oper- 
ating in some fashion on a signal to extract 
some useful information from EEG data, dif- 
ferent features such as power spectral densi- 
ties, energy and root mean square (RMS) were 
extracted from the signal with the help of 
MATLAB programming. 


(111) Neural Network classifiers 


We used feed forward neural network 
based on back propagation algorithm. It is 
assumed superior classifiers for discriminat- 
ing workload level (Wilson and Russell, 2003, 
Wilson and Russell, 2007; Wilson, Estepp, and 
Christensen, 2010; Wilson, Estepp, and Davis, 
2009). Twenty-five percentage of the inputs 
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were taken for validation and 20% for training 
and rest inputs were test data. Linear transfor- 
mation matrix was used to map between input 
and output. It had used features <x channels, 
matrix for training and testing data set. 


3. RESULTS 


The overall result was calculated on the 
basis of psychological (MATB-II test score 
analysis with subjective score) and physiolog- 
ical (EEGSignal) data analysis separately. 

The following three findings were 
extracted from MATB-II data. 


1. Subjective score was calculated 
using NASA-TIx scoring and total score dis- 


played in Figure2for comparison between 
LWL and HWL. 


Figure 2. Total NASA-TIx score of participants 
in the MATB-II 
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2. Objective score was calculated for 
system monitoring (sysmon) and tracking 
task in the form of response time (in second) 
and Root mean square deviation (RMSD) 
respectively. In sysmon, percentage of cor- 
rect responses were more in LWL case for 
five subjects (Figure 3) and also response time 
was less for HWL (increase stress sometime 
improve performance) (Figure 4). 


Figure 3. Percentage correct responses for 
system monitoring task 
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Figure 4. Response Time (in second) of system 
monitoring for participants who gave responses 
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3. Three subjects were unable to give 
the responseinsysmon as they were unable 
to shift their attention. Improve performance 
was observed in a tracking task for HWL as in 
figure 5. Applying t- test on objective scores, 
we found: t= 1.550 at degree of freedom =9 
for tracking task at probability = 0.155 and t 
= 1.030 at degree of freedom = 9 for system 
monitoring task at probability = 0.330.There 
were no significant difference between 
LWL and HWL task of tracking and system 
monitoring. 


Figure 5. Root means square deviation (RMSD) 
scores for tracking task 
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Three features are extracted from the 
EEG signal. To summarize the findings are: 


1. Subband energy value was increased 
as the workload increased for theta [4-8 Hz], 
alpha [8-13 Hz], beta [13-30 Hz] as showed 
in figure 6for channel AF3. More energy was 
displayed from channels when high attention 
is required to execute the task. 


Figure 6. Beta energy for AF3 channel for dif- 
ferent condition, energy is summarized among all 
ten participants. BL=baseline, LWL=Low Workload, 
HWL=High Workload 
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2. The RMS value of gamma sub-band 
had the most significant difference between 
NWL and LWL as displayed in Table | for all 
channels. 


Tablel. Significant result on 14 channels for 
RMS value after applying one way ANOVA. Differ- 
ence between NWL and LWL after applying post hoc 
test (Tuckey-d) 


Serial Channel F Value P 

number Name Value 
1 AF3 3.772 0.036 
2 AF4 3.245 0.0455 
4 F3 4 042 0.029 
4 F4 5.639 0.009 
5 Fi} 4.689 0.039 
6 FS 4 584 0.019 
a FCS 5.872 0.008 
& FC6 5117 0.013 
9 Ol 6.233 0.006 
10) O? 5.451 0.011 
11 P? 5.919 0.007 
1? PS 6.041 0.007 
13 T? 6.972 0.004 
14 TS 4.664 0.039 


3. The most important channels in En- 
gagement Index (EI) were AF3, AF4, F7 and 
F8 as we could see an increase in EI with the 
increase in workload clearly from figure 7. 
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Figure 7. Engagement index for each channel 
on Baseline (BL), Low workload level (LWL) and high 
workload Level (HWL) 
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4. The above mentioned three EEG fea- 
tures were taken as an input for NN classifiers 
and EI was selected as most appropriate input 
for workload classification after doing para- 
metric statistical testing. 

5. Confusion matrix for all 14 channels 
had been displayed in Table 2, showed an idea 
about channel identification for automated 
operator designing. As per the result accuracy 
was more on anterior frontal channels while 
less in temporal channels. 


Table 2. Confusion Matrix result for classifica- 
tion of NWL, LWL and HWL, after applying NN clas- 
sifiers with 1000 iteration for channels 


Serial num- Channel Percentage 
ber Name Accuracy 
l AF3 90) 
2 AF4 66.7 
3 F3 63.3 
4 F4 50 
5 Fi 10 
6 Fé 63.3 
1 FCS 60.9 
§ FC6 63.3 
9 Ol 50 
10 O2 56.7 
1] Py 60.9 
1? PS 60.9 
13 Ti 60.9 
14 Ts 46/7 
4. DISCUSSION 


Workload offloading is often required to 
reduce error and improve performance in the 
smart system. It can be done when we acquire 
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full knowledge regarding operator cognition 
and system interface. Itis evident that workload 
is task dependent and can vary from individ- 
ual to individual (Gawron, 2000; Mazloumi, 
Kumashiro, Izumi, and Higuchi, 2010). The 
objective of this experiment was to identify 
the measurement technique that can discrimi- 
nate the workload and to determine the best 
possible input EEG feature for classification 
of workload while designing load balancing 
logic (i.e. between human and machine) for an 
automated operating system. We found some 
answers which could be supportive for objec- 
tive completion. We discussed three methods 
to assess cognitive workload, i.e. task score, 
subjective score and spectral features of the 
EEG as per Wickens, 1988. Objective scores 
collected from sysmon and tracking tasks 
using MATB-I, failed to produce any signifi- 
cant difference. Difference in result failed to 
correlate the workload level with the perfor- 
mance of individuals. However, we found a 
subjective score making workload discrimina- 
tion, but we could not rely on subjective feel- 
ing because it was invasive which could be 
inappropriate for our objective. EEG was reli- 
able and modest measured for workload dis- 
crimination (Gevins and Smith, 2003; Gevins 
and Smith, 2005; Wang, Hope, Wang, Ji, and 
Gray, 2011). The primary goal was to identify 
the best EEG feature which could be taken as 
an input for NN classifiers. Out of three EEG 
features, 1.e. energy, RMS and EI, EI was best 
identified feature for NN classifiers. In pre- 
vious studies EI was also identified best cor- 
related feature with workload (Kamzanova 
et al., 2011). Second goal was to identify the 
best channels which provided the classifica- 
tion with the highest accuracy. Anterior fron- 
tal channels were the most appropriate chan- 
nels. The third goal was to identify EEG fea- 
ture which could give discrimination among 
workload level without adding any classifiers. 
Gamma sub-band RMS value was qualified to 
discriminate (except AF4) with significant dif- 
ference at P< 0.05. 


5. CONCLUSIONS 


To identify measurement technique for 
workload assessment supplemented design- 
ing of automated operator. Objective score 
failed to discriminate and subjective score 
succeeds, but they were invasive. We left with 
only electrophysiological method of workload 
discrimination that was necessary for design- 
ing of automated operator. Therefore, to rely 
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on electrophysiological measures did become 
one of the major key in workload classifica- 
tion (Lysaght, 1989; Noyes, J.M. and Bru- 
neau, 2007; Rubio, Diaz, Martin, and Puente, 
2004; Verma, 2012). Gamma RMS was iden- 
tified best feature without adding classifiers 
and EI was the best feature to be used as an 
input for NN classifiers. Best selected chan- 
nels were anterior frontal for workload clas- 
sification. The limitation of our study could be 
less number of subjects and channels in EEG. 
Result based on the onetime assessment of 
the workload, could have changed in the next 
assessment. Future direction of work will be 
based on the overcoming limitation with many 
time assessments with sufficient number of 
subjects and channels. 
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